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YuvAL Z. Flicker 

Abstract. Let ■0 : J7 ^ be a generic character of the unipotent radical U oi a Borel 
subgroup of a quasisplit p-adic group G. The number (0 or 1) of V'-Whittaker models on an 
admissible irreducible representation tt of G was expressed by Rodier in terms of the limit 
of values of the trace of n at certain measures concentrated near the origin. An analogous 
statement holds in the twisted case. This twisted analogue is used in [F], p. 47, to provide a 
local proof of the multiplicity one theorem for U(3). This asserts that each discrete spectrum 
automorphic representation of the quasisplit unitary group U(3) associated with a quadratic 
extension E/F oi number fields occurs in the discrete spectrum with multiplicity one. It is 
pointed out in [F], p. 47, that a proof of the twisted analogue of Rodier's theorem does not 
appear in print. It is then given below. Detailing this proof is necessitated in particular by the 
fact that the attempt in [F], p. 48, at a global proof of the multiplicity one theorem for U(3), 
although widely quoted, is incomplete, as we point out here. 



Let E/F be a quadratic extension of p-adic fields, p 7^ 2, and consider the basechange 
lifting from the quasisplit unitary group H = U(3, -E/F) in 3 variables to G = GL(3, F). 
Our main result is that there exists a family of suitably related functions t/j'fj ^ on H = 
\J{3,E/F) and i/j'^ on G = GL(3, i?) which are supported near the origin, such that the 
traces tr tthUj'h ndh) twisted traces tmi^'ip'^dg x a) stabilize for sufficiently large n and 
become equal to the Whittaker multiplicity (multiplicity in the space of Whittaker vectors) 
of the irreducible admissible representations tth of H and tc of G. This is a twisted analogue 
of a theorem of Rodier for the involution that defines H in G. 

Our motivation for considering such a twisted analogue of Rodier's theorem is that we 
found a gap in an attempted global proof (of [F], p. 48) of multiplicity one theorem for 
automorphic representations of U(3, E /F){Af). We use our result to provide a local proof, 
as suggested in [F], p. 47. 

This gap is different than the observation of Harder ([H], p. 173). The latter deals with 
the question of which representation in a packet is automorphic, assuming multiplicity one 
holds. 

In Section 1 we state a theorem of Rodier and explain what are Whittaker models, 
characters, and the measures concentrated near the origin which enter the statement. We 
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then state its twisted analogue of interest to us. In Section 2 we use these theorems to 
complete a key step in the proof of [F], p. 47, of multiplicity one theorem for the global 
quasisplit unitary group U(3). In Section 3 we explain why the global proof of [F], p. 48, 
of this multiplicity one theorem is not complete. In Section 4 we recall the main lines of 
Rodier's proof. In Section 5 the twisted analogue is reduced to Rodier's theorem. This 
completes the proof of the theorems of Sections 1 and 2. In the Appendix, Section 6, we 
derive another description of the Whittaker multiplicity, in terms of the coefficient of the 
regular orbit in the germ expansion of the character. 

1. Whittaker models and characters 

Rodier's theorem [R] , p. 161, (for a split group H) computes the number of ^/^^ -Whittaker 
models of the admissible irreducible representation tth of H in terms of values of the char- 
acter tr TfH or Xtth of '^H at the measures t(jH,ndh which are supported near the origin. 

We proceed to explain the notations to be used in Rodier's theorem. For simplicity and 
clarity, instead of working with a general connected reductive (quasi) split p-adic group H 
as in [R], we let H he a, specific unitary group. To define it, we take G = GL(r, E), where 
E/F is a quadratic extension of p-adic fields of characteristic zero, p ^ 2. Let x i-^x denote 
the generator of Gal{E / F) . For g = (gij) in G we put 'g = i^ij) and ^g = (gji). Then 
a{g) — J~^*g~^J, J — {{—iy~^ Si^r+i-j) , defines an involution a on G. The group H — G^ 
of g & G fixed by cr is a quasisplit unitary group \J{r, E/F). 

Denote by : Uh ^ a character on the unipotent upper triangular subgroup Uh 
of H. It is necessarily unitary, namely its values lie in the unit circle = e C; j^j = 1}. 

We assume that is generic, namely nontrivial on each simple root subgroup. There 
is only one orbit of generic under the action of the diagonal subgroup of H on Uh 
by conjugation. Hence we can and will work with the specific character : Uh — C^, 
defined by i^nii'^ij)) = V'(X]i<j<r '"jJ+i)- Here ip : F ^ is an additive character which 
is 1 on i? and not identically 1 on 'k~^R. Further, R is the ring of integers of F, and tt is a 
generator of the maximal ideal of R. Note that Ur-j,r-j+i = 

By tpjj- Whittaker vectors we mean vectors in the space of the induced representation 
ind^^{^jj). They are the functions (p : H ^ C with ip{uhk) = i/}fj{u)ip{h), u e Uh^ h E H, 
k e K^p, where JC^, is a compact open subgroup of H depending on (/?, which are compactly 
supported on Uh\H. The group H acts by right translation. 

The multiplicity dime HomH(ind^^ ipjj, tth) of any irreducible admissible representation 
tth of H in the space of ■0^- Whittaker vectors is known to be or 1. In the latter case we 
say that tvh has a V'H'Whittaker model or that it is ip ^-generic. 

Let Qq be the ring of r x r matrices with entries in the ring of integers Re of E. It 
is a subring of the ring ^ of r x r matrices with entries in E. Let da be the involution 
d(T{X) = —J~^*XJ. Its set of fixed points in Q is denoted by H. Let Ho = H (1 he 
the set of X in fixed by the involution da. Write Hn = exp(7in), Hn = 'k'^'Hq. For 
n > 1 we have = ^UH,nAH,nUH,n, where UH,n = Uh ^ H^, and AH,n is the group 
of diagonal matrices in Hn- Define a character '0H,n : -ff — ^ C^, supported on H^, by 
'ipH,nCbu) = '0(Ei<j<r *^ ^ *UH,nAH,n, u = (uij) G UH,n- Alternatively, 
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by 

V'H.nlexpX) = chH„(X)V'(tr[X^-2-/?^]), 

where ch-^^ indicates the characteristic function of Tin = ^"^TYq in 'H, and Ph is the r x r 
matrix whose nonzero entries are 1 at the places — 1), 1 < j < r. Denote by ch^ 
the constant measure of volume one supported on the compact subgroup in the Hecke 
algebra of H, i.e., = \Hn\~^ '^^h„ dh, where \Hn\ denotes the volume of in dh. 

Since tth is admissible, for each test measure fn dh {dh is a Haar measure on H and 
fn is a locally constant compactly supported complex valued function on H), the image of 
TrnifRdh) is finite dimensional and its trace tTTTHifn dh) is finite. 

Rodier's theorem asserts 

Theorem 1. The multiplicity dime Horn niii^d^^ipH j'^h) is equal to 

limtr nH{iJH,neH„)- 

n 

In fact the limit stabilizes for sufficiently large n. Throughout this paper "= lim^ a^" 
means "equals On for all sufficiently large n" . 

We need a twisted analogue of Rodier's theorem. It can be described as follows. 

Let TT be an admissible irreducible representation of G which is cr- invariant: tt ~ "'tt, 
where ^7r{a{g)) = 7T{g). Then there exists an intertwining operator A : tv ^ '^tt, with 
^'^(fi') = ^('^(fi'))^ fo^^ ciU g E G. Since tt is irreducible, by Schur's lemma is a scalar 
which we may normalize by = 1. Thus A is unique up to a sign. Denote by G' the 
semidirect product G x {a). Then tt extends to G' by 7r(a") = A. 

Define V's : E £} hy ipE^x) — 'ip{x + x). Define a character ip : U — > C"*^ on the 
unipotent upper triangular subgroup U of G by il){{uij)) = V'£(X^i<j<r '^jj+i)- This one 
dimensional representation has the property that il}{a{u)) = for all u in U. Note that 
■0('u) = ij)fj{u'^) at G Uh = UnH. There is only one orbit of generic cr-invariant characters 
on U under the adjoint action of the group of a-invariant diagonal elements in G. 

Suppose that tt is ^'-generic, namely Homc(ind^'0; tt) ^ {0}. Here ind^V consists of the 
functions : G — > C with (fi{ug) = ip{u)(fi{g), u & U , g & G, which are compactly supported 
on U\G. Then we normalize A by A(p' = "'(p', where "'(p{g) = (p{a{g)), on the image (p' in 
TT of the (p. 

Write Gn — exp(^„), where = t^^Go- For n > 1 we have Gn — ^UnAnlln, where Un — 
U n Gn, and A^ is the group of diagonal matrices in Gn- Define a character if^n '■ G ^ 
supported on Gn by ipni^bu) = V's(I]i<j<r where *b e *UnAn, u = (uij) e Un- 

Alternatively, i/^^ : G — > is defined by 

V'n(expX) = cha„(X)^£;(tr[Xir-2-/3]) 

where /? is the r x r matrix with entries 1 at the places [j, J — 1), 1 < j < r, and elsewhere. 

A first version of a cr-twisted analogue of Rodier's theorem asserts that the Whittaker 
multiplicity is equal to the twisted trace tr it {il^n^Gn ^ cr) fo^ all sufficiently large n, where 
is defined analogously to ch^ . 
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A more useful version for us is stated in terms of the twisted character xZ- Let us first 
restate Rodier's theorem this way. 

Denote by Xtth ^hc character of tth- It is a complex valued conjugacy invariant function 
on H which is locally constant on the regular set and locally integrable on H (Harish- 
Chandra [HC], Theorem 1) defined by triTH{fHdh) — Jjj XnH{h)fH{h)dh for all fndh. 

Then Rodier's theorem can be stated as asserting that the Whittaker multiplicity of 
Theorem 1 is equal to 

lim / Xn„ih)'ilJH,nih)eHr,{h). 
" Jh 

Analogously, the twisted character Xn of tt is a complex valued cr-conjugacy invariant 
function on G (that is, its value on {hga{h)~^} is independent of h E G) which is locally 
constant on the cr-regular set {g with regular gcr{g)), locally integrable (Clozel [C], Thm 1, 
p. 153) and defined by ti TT{f dg) A — ^Qx'^{9)f{.9)dg for all test measures f dg. 

The (T-twisted analogue of Rodier's theorem of interest to us is as follows. Let ea<y^ denote 
the constant measure of volume 1 supported on the compact subgroup = {g — erg', 9 G 
Gn} of G. As is Hn, ec^ lies in the Hecke algebra of H. 

Theorem 2. The multiplicity dime Homg/ (ind^ ^) = dimcHomG(ind^^,7r) is equal to 

Ig- Xni9)^ni9)eG-{9) for all sufficiently large n. 

Remark. Recall that Hom(5(7ri, ) = HomG;(7r2, tt^) as both spaces can be identified with 
the space of (tti, 7r2)-invariant bilinear forms. The contragredient (ind^ p)^ is Ind^(^^p^) 
([BZl], 2.25(c); Ind indicates non compact induction, H is a closed subgroup of G, p is a 
representation of H, tt of G). Frobenius reciprocity asserts 

HomG(indf p, tt) = Homij(^p, 7r|iy) 

and equivalently HomG(7r, Indg p) = UomninlH, p) ([BZl], (2.28) and (2.29)). 

2. Multiplicity one for U(3) 

Let us recall how the Theorems are used in the proof of Proposition 3.5 of [F], p. 47. 
Thus in this Section we work only with H = lJ{r, E / F) and G = GL{r,E), r = 2 or 3, 
of Section 1. We are given a square integrable irreducible admissible representation p of 
the quasisplit group U(2,i?/F). Its stable basechange to GL(2, £") is denoted by r. The 
unstable basechange is r k. Let tt = /(r k) be the normalizedly induced representation 
of GL(3, -E). This tt is invariant under the involution a (ours and of [F]). It is generic. 
For all matching measures fdg and fndh on G = GL(3, E) and H = U(3, E/F), using an 
identity of trace formulae and orthogonality relations for characters [F] obtains an identity 

tT7r{fdg X a) = (2m + 1) y^tr TTHifudh). 

The sum ranges over finitely many (in fact, two times the cardinality of the packet of p) 
inequivalent square integrable irreducible admissible representations tvh of U(3, E/F). The 
number m is a nonnegative integer, independent of tth- 
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Proposition 3.5 of [F]. The nonnegative integer m is zero, and there is a unique generic 
tth in the sum. The other 2[{p}] — 1 representations tth are not generic. 

Note that our tt, tth, fdg, fudh, G, H, are denoted in [F] by H, tt, (j)dg', fdg, G' , G. 

Proof. The identity for all matching test measures fdg and fndh implies an identity of 
characters: 

for alld eG = GL(3, E) with regular norm e H ^ U(3, E/F). Note that d ^ is a 

stable c7-conjugacy class function on G, while 7 1— > Xtth (t) ^ stable conjugacy class 
function on H. We use Theorem 2 with G = GL(3, and H = G" . Then = H^. On 
5 e G^, the norm N5 of the stable cr-conjugacy class 5 is just the stable conjugacy class of 
5\ Hence x%{5) = (2m + 1) X.n ('^') at 5 G = i^^- 
We claim that for 5 = expX, X e = Tin, we have 

V;£(tr[X7r-2-/3]) = V'(tr[2X7r-2-/3^]). 

For this we note that (3 = Ph and iPe{x) = ip{x + x). 

Moreover we claim that ^„((^) = ^Hni^'^) ^ ^ — ^n- For this we note that 

/ I x'z\ 

•^^{^hu) = ^JeHx + y)Tr~^'^) ii u = I 1 y J , and this is = '0(2(a; + x)iv~^^) y = x. But 

\o 1/ 

i^H,nCbu) = •0((x + x)7r~^"') at such u G Uh (thus with y = x). 
Now (i(5f^) = (igr when p ^ 2. It follows that 

l = dimcHomG(indgV,7r)= / x''MMS)eG?,{S) 

= I (2m + l)5^x.«(d^')V'i/,n(5')eHj5') 

= (2m+ 1) ^dimcHomj/(ind^^ Vn^TTi?). 

Hence m = and there is just one generic tth in the sum (dime 7^ 0, necessarily = 1). □ 

The excluded case of p = 2 might follow on counting the factors of 2 in our argument. 

We repeat the conclusion of [F]. Note that the unrestricted trace identity in proven in 
[Fl], and the fundamental lemma in [F2]. Both proofs employ simple methods: the usage 
of regular- Iwahori functions in [Fl] removes the need to compute and compare weighted 
orbital integrals, and explicit double coset decomposition reduces the fundamental lemma 
in [F2] to elementary volume computations. 
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Corollary. Each discrete spectrum automorphic representation 0/ U(3, £'/F)(A) occurs 
in the discrete spectrum with multiplicity one. Each packet (defined in [F]) of such an 
infinite dimensional representation contains precisely one irreducible representation which 
is generic. Each packet (defined in [F]) of tempered admissible representations of IJ (3, E / F) 
contains precisely one irreducible representation which is generic. There are no generic 
representations in any (nontempered) quasipacket, locally and globally. 

This type of argument, relating the number of Whittaker models to the values of the 
characters at suitable measures supported near the origin, was first employed in [FK] , which 
appeared in 1987, in an analogous situation of the metaplectic correspondence between 
GL(r) and its n-fold covering group. 

Remark. On the space L^(GL(n, F)\ GL(n, A)) of automorphic forms </>, we define the in- 
volution 0" by (r(a)(j))(g) = (f)(a(g)). On the space of Whittaker functions W (W(ng) = 
ilj(n)W(g), g G GL(n, A), n G N(A), where denotes the unipotent upper triangular sub- 
group of GL(?i)), we choose the natural action of cr, by '^^^(gf) = W(ag). The map (f) 1— > W(p, 
where W(j)(g) = //v(A)\Ar(A) (t^(f^9)'^('^)dn., respects the action of cr. Thus the global normal- 
ization of the action of a is the product of the local normalizations '^Wy(g) = Wy(ag). 

Note also that underlying the character identity is an embedding of the local representa- 
tion TT, which is a-elliptic, as a component of a global a-invariant cuspidal representation 11 
of GL(3, A^;) where F is a totally imaginary field. The character identity follows from using 
the trace formulae identity, applying "generalized linear independence of characters" and 
thus isolating H, and further, tt. The normalization of a on the generic (H and) tt implies 
that no sign occurs in the character identity. 

Had we not fixed the choice of the sign of r(a) at all places, the twisted character in our 
trace identity (at our place) might in principle be replaced by its negative. However, the 
identity 

-tT7T(fdg xa) = (2m+l)J2^T7TH(fHdh), -x^(5) = (2m + 1) ^ x.r„ (7), 

cannot hold, as evaluating it with our fdg = ipn^c ^ind fndh = '4>H,n^Hni n large, would 
give —1 on the left, and a nonnegative integer on the right. This provides an independent 
verification that our normalization of the sign of r(a) is correct. 

3. Incomplete global proof 

The second proof of Proposition 3.5 of [F], on p. 48, is global, but incomplete. The false 
assertion is on lines 21-22: "Proposition 8.5(iii) (p. 172) and 2.4(i) of [GP] imply that for 
some TT with m(7r) ^ above, we have m(7r) = 1". Indeed, [GP], Prop. 2.4, defines Lq -^ 
to be the orthocomplement in the space Lq (of cusp forms) of "all hypercusp forms" , and 
claims: "(i) Lq i has multiplicity 1". ([GP], 8.5 (iii), asserts that tt is in Lq i). Now the 
sentence of [F], p. 48, 1. 21-22 assumes that [GP], 2.4(i), means that any irreducible tt in 
Lq i occurs in Lq with multiplicity one. But the standard techniques of [GP], 2.4, show only 
that any irreducible tt in Lq ^ occurs in Lq ^ with multiplicity one. A-priori there can exist 
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tt' in Lq, isomorphic and orthogonal to tt C Lq j^. In such a case we would have m(7r) > 1. 
Such a tt' is locally generic (all of its local components are generic), isomorphic to a generic 
cuspidal TT, and the question boils down to whether this implies that tv' is generic (the linear 
form L{(j)) = Jj^^^p,^^j^^^^^ (p{u)ipfj{u)du is nonzero on tt C Lq). This last claim might follow 
on using the theory of the Thcta correspondence, but this has not been done as yet. In 
summary, a clear form of [GP], 2.4(i) is: "Any irreducible tt in Lg i occurs in Lq ^ with 
multiplicity one." In the analogous situation of GSp(2) such a statement is made in [So]. 
It is not sufficiently strong to be useful for us. 

We noticed that the global argument of [F], p. 48, which was first proposed in a preprint 
version of [F] in 1983, is incomplete while generalizing it in [F3] to the context of the sym- 
plectic group, where work of Kudla, Rallis, Langlands, Shahidi on the Siegel-Weil formula 
and on L-functions is available to show that a locally generic cuspidal representation which 
is equivalent at almost all places to a generic cuspidal representation is generic. A local 
proof, based on a twisted analogue of Rodier's result, is also used in [F4], in the context of 
the symmetric square lifting. 

4. Review of Rodier's proof 

We shall reduce Theorem 2 to Theorem 1 for G (not H), so we begin by recalling the 
main lines in Rodier's proof in the context of G. Choose d = diag{'ir~'^'^^ , . . . , 7t^~^). 
It lies in the unitary group, namely a{d) = d, since tt is in F. Put Vn = d^Gnd~'^ and 
tpni^j) = i})n{d~'^vd'^) {v G Vn). Rccall that ipn is defined to be supported on Note that 
(7{Gn) = Gn, cr{Un) = Un, CTil^n = V'n, and that the entries in the j'th line (j 7^ 0) above or 
below the diagonal of f = [vij) in Vn lie in Re (thus G 7r*^^~^-^^"^i?s if j > 0, 

and also when j < 0). Thus V„ fl C/ is a cr-invariant strictly increasing sequence of compact 
and open subgroups of U whose union is U, while Vn r\ H) - where *UH is the lower 
triangular subgroup of G - is a strictly decreasing sequence of compact open subgroups of 
G whose intersection is the element / of G. Note that = ^ on VnCiU. 

Consider the induced representations indy^^„, and the intertwining operators 

:mdg,^n^mdg„^m, 

JG 

{g in G, ip in ind^^ Vn: = iKnT^ly^'^S', \Vm\ denotes the volume of V^, denotes 
the characteristic function of V^). For m > n > 1 we have 

{K^){9) = i(.evrnnui')*<p){g) = / ij{u)cp{u-^g)evr^nu{u). 

JG 

Hence o A™ = for £ > m > n > 1. So (indg^ Vn, (m > n > 1)) is an inductive 
system of representations of G. Denote by (/, An ■ indy^ Vn ~^ ^) ^ 1) limit. 
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The intertwining operators 0„ : indy^ tj)^ ind^^-^, 

{K{v)){9) = (V'li7 * f){9) = I tp{u)(p(u-^g)du, 

Ju 

satisfy (j)rn ° = (p^ in > n > 1. Hence there exists a unique intertwining operator 
(f) : I ^ ind-u ^ with (/) o = (pn for all n > 1. Proposition 3 of [R] asserts that 

Lemma 1. The map (p isomorphism of G -modules. □ 

Lemma 2. There existsriQ > 1 such thatip^*ii}^*'ip^ = \Vn\\Vmr\Vn\ip^ for allm> n> uq. 

Proof. This is Lemma 5 of [R] . We review its proof (the first displayed formula in the proof 
of this Lemma 5, [R], p. 159, line -8, should be erased). 

There are finitely many representatives Ui in U for the cosets of Vm modulo VnnVm- 
Denote by e{g) the Dirac measure in a point g of G. Consider 

{e{ui)*ip^lv^nvji9) = / e{ui)igh-^)iip^lv^nvjih)dh = ip^iu-^g) = ip^{ui)-^ip^ig). 

Jg 

Note here that if the left side is nonzero, then g G UiiVm^Vn) C Vm- Conversely, if 5^ G Vm-, 
then g G u^{Vm n K) for some i. Hence = Ei'0m(^i)£(^i) * ^nlv„nK», thus 

i 

Since Vnl^^nv;. * V'n = lKi n K|t/'n> this is 

i 

But the key Lemma 4 of [R] asserts that * £(tt) 7^ implies that w G Fn- Hence the 
last sum reduces to a single term, with ttj = 1, and we obtain 

= |K.nK|t/'n*^n = iK.nKllKlV'n- 

This completes the proof of the lemma. □ 
Lemma 3. For an inductive system {In} we have HomG(lim/^, tt) = limHomG(/n, tt). 

Proof. See, e.g., Rotman [Ro], Theorem 2.27. It is also verified in [R]. □ 
Corollary. We have dime HomG!(ind^ t/;, tt) = lim„ tr 7r(V'n'^^)- 

Proof. As the dime Hom(3(indy^ tt) are increasing with n, if they are bounded we get 
that they are independent of n for sufficiently large n. Hence the left side of the corollary 
is equal to lim^ dime Home (indy^ tt). This is equal to lim^ dime HomG(indQ^ Vn^ ti") 
since V„(t') = '^n{,d~'^vd^). This is equal to lim^i dime HomG^('i/'n, 7r|Gn) by Frobenius reci- 
procity. This is equal to the right side of the corollary since \Gn\~^'n{ipndg) is a projection 
from TT to the space of ^ in tt with 7r(^)^ = ipn{g)i {.9 ^ G^n), a space whose dimension is 
then IG^I"-*- tr 7r(7/'„ci^). □ 
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5. The twisted case 

We now reduce Theorem 2 to Theorem 1 for G. Note that since = '4>n, the representa- 
tions indy^ are cr-invariant, where a acts ornf E ind^^ if)^ by </? i-^ (T<^, {a(p){g) — ip{ag). 
Similarly — ij) and ind^ tp is u-invariant. We then extend these representations ind of 
G to the semidirect product G' = G >i (a) by putting {i{a)(p){g) = (p{a{g)). 

Let TT be an irreducible admissible representation of G which is cr-invariant. Thus there 
exists an intertwining operator A : tt '^tt, where "^n^g) = n{a{g)), with Arrlg) = 'K{a{g))A. 
Then A'^ commutes with every TT{g) {g e G), hence A"^ is a scalar by Schur's lemma, and can 
be normalized to be 1. This determines ^ up to a sign. We extend tt from GtoG' = Gy\ {a) 
by putting 7r(cr) = A once A is chosen. 

If HomG(ind^^, tt) ^ 0, its dimension is 1. Choose a generator £ : ind^t/; — > tt. Define 
A-.TT^nhy Ae{<p) = e{i{a)<p). Then 

HomGr(ind[; — Home (ind^; 

Similarly we have HomG(ind^^ '^n^'^) — Homo/ (ind^^ tt). 
The right side in the last equality can be expressed as 

HomG'(indg^ Vn,7r) = HomG;^«,7r|G';) (G^ = Gn x {o))- 

The last equality follows from Frobenius reciprocity, where we extended il^n to a character 
on by i^'^{a) = 1. Thus = V'n + C> with il;^{g x (3) = S^^Mg), e {1, ^r}- 
In this case Homg;^ (V'ni """l^n) is isomorphic to the space tti of vectors ^ in tt with 
^{9)^ = i^nig)^ for all g in G'^. In particular Tr{g)^ = ipn{g)C for all g in Gn, and Tv{a)^ = ^. 
Clearly \G'^\~^ir('i/j'^dg') is a projection from the space of tt to tti (it is independent of the 
choice of the measure dg'). Its trace is then the dimension of the space Hom. We conclude 
a twisted analogue of the theorem of [R] : 

Proposition 1. The mte^fer dime Homer' (ind^V; ^r) is equal to \G'^\~^ trTT{'ilj'^dg') for all 
sufficiently large n. □ 

Note that G'^ is the semidirect product of Gn and the two-element group (a) . With the 
natural measure assigning 1 to each element of the discrete group (it), we have \G'^\ = 2|G„|. 
The result is then, for all sufficiently large n, 

^ tr7r(V'neG„) + ^ tr7r(V'neG„ x a) 

(as = ipli^ + ip^, Vn — V'n and tT7r{'ip^dg) = tT7r{'ipnd9 x a)). By (the nontwisted) Rodier's 
Theorem 1, 

dimcHomG(ind^t/')7r) = limtr 7r(V'neG„), 



we conclude 
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Proposition 2. We have dime Home;/ (ind^V; ^) — lin^n tr 7r(?/j„eG„ x a) for all a- 
invariant irreducible representations tt of G. □ 

The terms in the hmit on the right can be written in terms of Harish-Chandra's twisted 
character, as 

/ xl{9)^n{g)eGM- 
Jg 

Again, put ec^ = IG^I""*^ ^GZ. ^9 where chfja is the characteristic function of in G. 
Proposition 3. The last displayed integral is equal to 

/ xl{9)'^n{g)eGi{g)- 

Proof. Consider the map x G'^\Gn —>■ Gn, {u,k) i— > k~^ua{k). It is a closed immersion. 
More generally, given a semisimple element s in a group G, we can consider the map 
Zqo{s) X Zqo{s)\G^ G^ by (w, /c) ^ k~^usks~^ . Our example is: {s,G) = {a,Gn x (a)). 

Our map is in fact an analytic isomorphism since Gn is a small neighborhood of the 
origin, where the exponential e : — > Gn is an isomorphism. Indeed, we can transport the 
situation to the Lie algebra Qn- Thus we write k = , u = , a{k) = e^^"'''^^\ k~^ua{k) = 
Q^-^+{do-)iY) ^ smaller terms. Here {da){Y) = —J~^*Y J . So we just need to show 

that {X,Y) ^ X - Y + {da){Y), Zg^{a) + ^^(niod (a)) ^ ^n, is bijective. But this is 
obvious since the kernel of (1 — da) on Qn is precisely Zg^{a) — {X G Qn\ {da){X) — X}. 

Changing variables on the terms on the right of Proposition 2 we get the equality: 

/ xZi9)M9)eGA9) 
= \Gn\~^ [ [ xl{k~^ua{k))tl;n{k~^ua{k))dkdu. 

Jg- JGl\Gr, 

But aijjn — i^n, il^n Si homomorphism (on Gn), Gn is compact, and xZ i^ ^ cr-conjugacy 
class function, so we end up with the expression of the proposition. Note that xZ i^ locally 
integrable on G^ and locally constant on its regular set by the character relation stated in 
the proof of Prop. 3.5 of [F] above. The proposition, and Theorem 2, follow. □ 

6. Appendix. Germs of twisted characters 

Harish-Chandra [HC] showed that x-w is locally integrable (Thm 1, p. 1) and has a germ 
expansion near each semisimple element 7 (Thm 5, p. 3), of the form: 

(7exp 

o 

Here O ranges over the nilpotent orbits in the Lie algebra Ai of the centralizer M of 7 in G, 
jjLo is an invariant distribution supported on the orbit O, 'jlo is its Fourier transform with 
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respect to a symmetric nondegenerate G-invariant bilinear form B on Ai and a selfdual 
measure, and c^(0,7r) are complex numbers. Both jio and c^(0,7r) depend on a choice of 
a Haar measure do on the centralizer Zg{Xq) of Xq G O, but their product docs not. The 
X ranges over a small neighborhood of the origin in Ai. We shall be interested only in the 
case of 7 = 1, and thus omit 7 from the notations. The size of the domain where the germ 
expansion holds is studied in Waldspurger [W] . 

Suppose that G is quasisplit over F, and U is the unipotent radical of a Borel subgroup 
B. Let ip : U ^ he the nondegenerate character of U (its restriction to each simple root 
subgroup is nontrivial) specified in Rodier [R], p. 153. The number dime Hom(ind^ ^, tt) 
of ^/'-Whittaker functionals on tt is known to be zero or one. Let Qq be a selfdual lattice in 
the Lie algebra G of G. Denote by cho the characteristic function of Qq in Q. Rodier [R], p. 
163, showed that there is a regular nilpotent orbit O = such that c(C, tt) is not zero iff 
dime Hom(ind^t/') is one, in fact jLio(cho)c(0, tt) is one in this case. Alternatively put, 
normalizing by /^©(cho) = 1, we have c((9,7r) = dime Hom(ind[/ tt). This is shown 
in [R] for all p ii G = GL(r, F), and for general quasisplit G for all p > 1 + 2^^g^nQ,, 
if the longest root is ^q,^^ n^d in a basis S of the root system. A generalization of 
Rodier 's theorem to degenerate Whittaker models and nonregular nilpotent orbits is given in 
Moeglin- Waldspurger [MW]. See [MW], L8, for the normalization of measures. In particular 
they show that c((9, tt) > for the nilpotent orbits O of maximal dimension with c{0, tt) 7^ 
0. For applications to minimal representations see Savin [S]. 

Harish-Chandra's results extend to the twisted case. The twisted character is locally in- 
tegrable (Clozel [C], Thm 1, p. 153), and there exist unique complex numbers c^(C, tt) ([C], 
Thm 3, p. 154) with x^(expX) = J]]^ c^(0, 7r)//o(X). Here O ranges over the nilpotent 
orbits in the Lie algebra of the group G^ of the g E G with g = 9{g). Further, no is an 
invariant distribution supported on the orbit O (it is unique up to a constant, not unique 
as stated in [HC], Thm 5, and [C], Thm 3); /xo is its Fourier transform, and X ranges over 
a small neighborhood of the origin in . 

In this section we compute the expression displayed in Proposition 3 using the germ ex- 
pansion x^(expX) = C^iO, n)flo{X). This expansion means that for any test measure 
fdg supported on a small enough neighborhood of the identity in G we have 



Here O ranges over the nilpotent orbits in Q'^ , ixo is an invariant distribution supported 
on the orbit O, Jlo is its Fourier transform. The X range over a small neighborhood of the 
origin in Q'^ . Since we are interested only in the case of the unitary group, and to simplify 
the exposition, we take G = GL(r, E) and the involution a whose group of fixed points is 
the unitary group H = U(r, E/F). In this case there is a unique regular nilpotent orbit Oq. 

We normalize the measure fiOo on the orbit Oq of /3 in Q"^ by the requirement that 
/UC)Q(chg) is 1, thus that jpj^T^n.g<y d^OaiX) — g"''^™^'-^") for large n. Equivalently a measure 
on an orbit O ~ GIZq{Y^ {Y G (9) is defined by a measure on its tangent space m = 
QjZgiy^ ([MW], p. 430) at F, taken to be the selfdual measure with respect to the 
symmetric bilinear nondegenerate F- valued form -By(X, Z) — tr(y[X, Z]) on m. 




o 



c"(C,7r) / [/ /(expX)V'(tr(XZ))dX]d//o(Z). 
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Proposition 4. If tt is a a -invariant admissible irreducible representation of G and Oq is 
the regular nilpotent orbit in Q'^ , then the coefficient c'^{Oo, tt) in the germ expansion of the 
a-twisted character xZ of tt is equal to 



dime Home (ind^ i/*, tt) = dime HomG(ind^ tj)^ tt). 
This number is one if tt is generic, and zero otherwise. 

Proof. We compute the expression displayed in Proposition 3 as in [MW], 1.12. It is a sum 
over the nilpotent orbits O inQ'^, of c'^{0,7r) times 

\G^J-'f2o{ipnoe) = \G^J-^fxoii^e) = \G^J-^ f i^e{X)d^io{X). 

Jo 

The Fourier transform (with respect to the character '^e) of V'n ° e, 

f^e{Y) = / V'nlexp Z)V^s(tr ZY)dZ = / ^'^(tr ^(Tr-^-/? - Y))dZ, 
JQ'^ Jgz 



is the characteristic function of tt P+tt "^Qq = tt (P+it'^Qq) multiplied by the volume 
\g^\ = \G^\ of g^. Hence we get 

= / df,o{X) = q^'''^^''^ [ df,o{X). 

The last equality follows from the homogeneity result of [HC], Lemma 3.2, p. 18. For 
sufficiently large n we have that P+'k'^Qq is contained only in the orbit Oq of (3. Then only 
the term indexed by Oq remains in the sum over O, and 



equals g-'^dim(e'o) (^cf_ [MW], end of proof of Lemme 1.12). The proposition follows. □ 
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